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Abstract: Closed formulas are known for S(k, 0; n), the number of standard Young tableaux 
of size n and with at most k parts, where 1 < k < 5. Here we study the analogue problem 
for S(k,£;n), the number of standard Young tableaux of size n which are contained in the 
(k, £) hook. We deduce some formulas for the cases k + £ < 4. 
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1 Introduction 

Given a partition A of n, A h n, let \ X denote the corresponding irreducible S n character. Its 
degree is denoted by deg \ X — f X an d is equal to the number of Standard Young tableaux 
(SYT) of shape A [7], [8], [12], [14]. The number f x can be calculated for example by the 
hook formula [7J Theorem 2.3.21], p2J Section 3.10], [J4J Corollary 7.21.6]. We consider the 
number of SYT in the (k, £) hook. More precisely, given integers k, £, n > we denote 



H(k, £; n) = {A = (Ai, A2, . . .) | A h n and Afc+i < 



and S(k,£;n)= / 

XeH(k/;n) 



X 



1.1 The cases where S(k,£;n) are known 
For the "strip" sums S(k,0;n) it is known [TU] [H] that 



S(2, 0; n) = ( " ) and 5(3, 0; n) = ^ 

\L 2 J/ j>o J + 



1 (n\{2j 



2jJ \3 



Let Cj = j^- ( j ? ) be the Catalan numbers, then Gouyon-Beauchamps [6] [U] proved that 



5(4. 



I - 1 

0; n) = Cyn+i j • C|-n+i-| and 5(5, 0; n) = 6 I . J • Cj ■ 

3=0 



(2J + 2)! 



(j + 2)!(j + 3)!' 
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As for the "hook" sums, until recently only S(l, l;n) and S(2, l;n) = >S(l,2;n) have been 
calculated: 

1. It easily follows that S(l, 1; n) = T~ x . 

2. The following identity was proved in [Til Theorem 8.1]: 

5(2,15 71)= (1) 



r=0 



IV. 



L^pjy \r J fc! • (k + 1)! • (n - 2k - 2)! • (n - fc - 1) • (ra - fc) 



1. 



1.2 The main results 

In Section |2] we prove Equation ( ITU1) . which gives (sort of) a closed formula for S"(3, l;n) 
in terms of the Motzkin-sums function. For the Motzkin-sums function see [T3| sequence 
A005043]. Equation ([TO]) in fact is a "degree" consequence of a formula of S n characters, of 
interest on its own, see Equation (jSj). 

In Section [3] we find some intriguing relations between the sums S(4,0;n) and the "rectan- 
gular" sub-sums S'*(2,2, ;ti), see below identities f|T2|) and (TT~3]) . 

Finally, in SectionHJwe review some cases where the hook-sums S(k, £; n) are related, in some 
rather mysterious ways, to humps calculations on Dyck and on Motzkin paths, see ( Tl4j) . ( |T6l) . 
and Theorem 14.11 

As usual, in some of the above identities it is of interest to find bijective proofs, which might 
explain these identities. 

Acknowledgement. We thank D. Zeilberger for verifying some of the identities here by 
the WZ method. 

2 The sums 5(3, l;n) and the characters x(3, l;n) 

Define the S n character 

X (k,£;n)= Yl * A so deg( X (k,l;n)) = S(k,£;n). (2) 

\£H(k,l;n) 

2.1 The Motzkin-sums function 

Define the S n character 

\n/2\ 

*( n ) = X] x (k,h,in ~ 2k) and denote deg^(ra) = a(ri). (3) 

fc=0 
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We call ty(n) the Motzkin-sums character. Note that 



j „ (k,k,l n ~ 2k ) r(k,k,l n - 2k ) n - 

degx v ' = P ' 



(k - 1)! • k\ - (n - 2k)\ ■ (n - k) - (n - k + 1) ' 
hence 

a ^ = S (k — 1)\ ■ k\ ■ (n — 2k)\ ■ (n — k) ■ (n — k + 1)' ^ 

By [Ml sequence A005043] it follows that a(n) is the Motzkin-sums function. The reader is 
referred to [13] for various properties of a(n). For example, a(n) + a(n + 1) = M n , where 
M n are the Motzkin numbers. Also a(l) = 0, a(2) = 1 and a(n) satisfies the recurrence: 

TL — 1 

forn>3 a(n) = - — - ■ (2 • a(n - 1) +3- a(n - 2)). (5) 
Note also that for n > 2 Equation (CQ) can be written as 

The asymptotic behavior of a(n) can be deduced from that of M n . We deduce it here, even 
though it is not needed in the sequel. 

Remark 2.1. As n goes to infinity, 

V^3 1 1 
a(n) ~ == • — = • 3 n and a(n) ~ - • M n . 



Proof. By standard techniques it can be shown that a(n) has asymptotic behavior 



X \9 

a(n) ~ c • I — I -a' 



n 

for some constants c, g and a - which we now determine. By [10] 

M„^.(lV /2 .3» 
2 v / 2^ W 

With 

M n = a(n) + a{n + 1) ~ c- (1 + a) ■ H^J ■ a n 
this implies that a = 3, that g = 3/2 and that c = ^§=- 

□ 
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2.2 The outer product of S m and S n characters 



Given an S m character Xm and an S n character Xn, we can form their outer product Xn®Xn- 
The exact decomposition of Xm®Xn is given by the Littlewood- Richardson rule [TJ, [8], [12], [14] . 
In the special case that Xn = X < " n ' ) ; this decomposition is given, below, by Young's rule. Also 



deg(xn®X (n) ) = deg(xn) 



n + m 
n 



(7) 



Young's Rule [5]: Let A = (Ai, A2, • • •) \~ m and denote by A +n the following set of partitions 
of m + n: 

\ +n = fa h n + m I /ii > Ai > fi 2 > A 2 > • ■ ■ }• 



Then 



Example 2.2. [10], [H] Given n, it follows that 

X (Ln/2j) ®X ([n/2l) = X(2, 0; n), and by taking degrees, S(2, 0; n) 



2.3 A character formula for x(3, l;n) 
Proposition 2.3. VFrf/i £/ie notations of (J2]) awd ©, 



n 

Ln/2j 



X(3, l;n) 



X (2,0,r i ) + ^*(j)(8)x (n - J ' ) 
i=o 



(9) 



5?/ taking degrees, Example \2.S\ together with ([3]) and (J7J) imply that 



S(3,l;n) 



n 



i=o 



(10) 



Proof. Denote 

n 

fi(n) = ^*0')®X (n " J ' ) 
3=0 

and analyze this 5 n character. Young's rule implies the following: 

Let \i h n, then by Young's rule x M has a positive coefficient in f2(n) if and only if fi e 
i/(3, l;n). Moreover, all these coefficients are either 1 or 2, and such a coefficient equals 1 
if and only if /1 is a < 2 two rows partition /x = (/ii,/i 2 ). It follows that 

A 



X(2,0;n) + fi(n)=2- x ; 

XeH(3,l;n) 

This implies ([9]) and completes the proof of Proposition 12.31 



(11) 
□ 
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3 The sums S(4, 0; n) and S*{2, 2; n 

Definition 3.1. 1. Let n = 2m, m > 2 and let H*(2,2;2m) C H(2,2;2m) denote the 
set of partitions H*(2, 2; 2m) = {(k + 2, k + 2, 2 m " 2 - fe ) h 2m | k = 0, . . . m - 2} (the 
partitions in the (2, 2) hook with both arm and leg being rectangular), then denote 

5*(2,2;2m) = £ / A . 

Aei7*(2,2;2m) 

2. Let n = 2m + 1, m > 2 and let #*(2, 2; 2m + 1) C if (2, 2; 2m + 1) denote the set of 
partitions H*(2, 2; 2m + 1) = {(k + 3, k + 2, 2 m " 2 - fc ) h 2m + 1 | k = 0, . . . m - 2} (the 
partitions in the (2,2) hook with arm nearly rectangular and leg rectangular), then 
denote 

5*(2,2;2m + l) = £ / A . 

A6#*(2,2;2m+1) 

Recall from Section O that 5(4, 0; 2m, - \) = C 2 m and 5(4, 0; 2m) = C m ■ C m+1 . We have 
the following intriguing identities. 

Proposition 3.2. 1. Let n = 2m then 

5(4, 0; 2m - 2) = C m _i • C m = S* (2, 2; 2m). 

Explicitly, we have the following identity: 

C^--*^- ■>).(*») = (12) 
m ■ (m + 1) \m — 1 J \m J 

(2m)! 

~~ ^ fc! • (fc + 1)! • (m - k - 2)! • (m - k - 1)! • (m - 1) • m 2 • (m + 1) ' 



Lei n = 2m + 1 then 

• 5(4, 0; 2m - 1) = • & m = S*(2, 2; 2m + 1). 

m + 2 m + 2 

Explicitly, we have the following identity: 

2m+1 -Cl = -, r L (2m\(2m+l\ (13) 



m + 2 m (m+l)-(m + 2) \m J \ m 



m-2 



^ (2m + l)!-2 



fc=0 



fc! ■ (A; + 2)! • (m - k - 2)! • (m - A; - 1)! • (m - 1) ■ m • (m + 1) • (m + 2) 



Proof. Equation ( fl2l is the specialization of Gauss's 2Fl(a, 5; c; 1) with a — 2 — m,b — 
1 — m, c = 2 PQ, and ( fTBl is similar. Alternatively, the identities ( Tl2l and ( Tl3l) can be verified 
by the WZ method [S], [E]. □ 
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4 Hook-sums and humps for pathes 

A Dyck path of length In is a lattice path, in Z x Z, from (0,0) to (2n, 0), using up-steps 
(1, 1) and down-steps (1,-1) and never going below the x-axis. A hump in a Dyck path is 
an up- step followed by a down-step. 

A Motzkin path of length n is a lattice path from (0, 0) to (n, 0), using flat-steps (1, 0), up- 
steps (1,1) and down-steps (1,-1), and never going below the rr-axis. A hump in a Motzkin 
path is an up-step followed by zero or more flat-steps followed by a down-step. 

We count now humps for Dyck and for Motzkin paths and observe the following intriguing 
phenomena: The humps-calculations in the Dyck case correspond the 2 x n rectangular 
shape A = (n,n) to the (1, 1) hook shape /i = (n, l n ). And in the Motzkin case we show 
below that it corresponds the (3, 0) strip shape partitions H(3, 0; n) to the (2, 1) hook shape 
partitions H(2, 1; n). 



4.1 The Dyck case 

The Catalan number 



r _ (2n)! 



n\[n + 1)! 

is the cardinality of a variety of sets [14] ; here we are interested in two such sets. First, 
C n = f^ n \ the number of SYT of shape in, n). Second, C n is the number of Dyck paths of 
length In. Let l-LD n denote the total number of humps in all the Dyck paths of length 2n, 
then 

\ n 

see [3], |4], [5]. Since ( 2n " 1 ) = f^ in \ we have 

C n = and UD n = 

which we denote by 

H : (n,n) — > (n,l n ). (14) 



4.2 The Motzkin case 

Like the Catalan numbers, also the Motzkin numbers M n are the cardinality of a variety of 
sets; for example M n = S(3, 0; n), [TO] , [T3], [131 sequence A001006], which gives the Motzkin 
numbers a SYT interpretation. Also, M n is the number of Motzkin paths of length n. Let 
HM„ denote the total number of humps in all the Motzkin paths of length n, then by [T3| 
sequence A097861] 
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We show below that this implies the intriguing identity H.M n = S{2, 1; n) — 1, which gives a 
SYT- interpretation of the numbers T-LM n . Thus the humps-calculations in the Motzkin case 
corresponds the (3, 0) strip shape partitions H (3, 0; n) to the (2, 1) hook shape partitions 
H(2, l;n). We denote this by 

■H : H(3,0;n) — > H(2,l;n). (16) 
Theorem 4.1. The number of humps for the Motzkin paths of length n satisfies 

UM n = S(2, l;n) - 1. 

Proof. Combining Equations ([1]) and (Tl5]) . the proof of Theorem 14.11 will follow once the 
following binomial identity - of interest on its own - is proved. 

Lemma 4.2. For n > 2 

|n/2j . x , a Ti-l 

n \ in — j \ ( 7i — r \ ( n 



j=l \s / \ s / r=0 



'E(J "J "5 m " h^" 1 - (17) 



n-l , v , x LfJ-1 , 



r=0 



l^J/ W ^ fe!-(ife + l)!-(n-2A;-2)!-(n-A;-l)-(7i-A;)' 

Equation (fT7|) was verified by the WZ method. About this method, see [9], [15]. We remark 
that it would be interesting to find an elementary proof of this identity. 

This completes the proof of Theorem 14.11 □ 
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